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A TWO STAGE EQUALIZER FOR TRELLIS CODED SYSTEMS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The invention disclosed in this patent application is related 
to the invention disclosed in United States Patent Application 
Serial Number [Attorney Docket No. PHIL06-01408] by M. Ghosh et al . 
entitled "System and Method for Reducing Error Propagation in a 
IS Decision Feedback Equalizer of an ATSC VSB Receiver" filed 
iB concurrently with this patent application. The invention disclosed 
^fl in this patent application is also related to the invention 
disclosed in United States Patent Application Serial Number 
[Attorney Docket No. PHIL06-01720] by K. Wittig et al . entitled 
ii "Generation of Decision Feedback Equalizer Data Using Trellis 
2 Decoder Traceback Output in an ATSC HDTV Receiver" filed 
concurrently with this patent application. The related patent 
applications are commonly assigned to the assignee of the present 
invention. The disclosures of the related patent applications are 
20 hereby incorporated by reference in the present patent application 
as if fully set forth herein. 
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TECHNICAL FIELD OF THE INVENTION 

The present invention is directed, in general, to digital 
5 communication devices and, more specifically, to a system and 
method for operating a two stage equalizer in trellis coded systems 
to reduce errors by utilizing symbol stream information from a 
trellis decoder to provide estimates for a decision feedback 
Q equalizer. 
IS 

C BACKGROUND OF THE INVENTION 



The Digital High Definition Television (HDTV) Grand 
Alliance (Grand Alliance) is a group of television manufacturing 
XS and research organizations in the television industry. After years 
of cooperative effort the Grand Alliance developed and proposed a 
standard for digital HDTV systems. The Grand Alliance standard has 
been adopted (with a few changes) by the Federal Communication 
Commission (FCC) as an official broadcasting standard for HDTV. 
2 0 The standard is known as the Advanced Television Systems Committee 
Digital Television Standard (the "ATSC Standard'') . 

The ATSC Standard for HDTV transmission over terrestrial 
broadcast channels uses a signal that consists of a sequence of 
twelve (12) independent time-multiplexed trellis-coded data streams 
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modulated as an eight (8) level vestigial sideband (VSB) symbol 
stream with a rate of 10.76 MHz. This signal is converted to a six 
(6) MHz frequency band that corresponds to a standard VHF or UHF 
terrestrial television channel, over which the signal is then 
5 broadcast. 

The ATSC Standard calls for two (2) bit data syTi±iols of the 
HDTV signal to be trellis encoded in accordance with an eight (8) 
level (i.e., a three (3) bit) one dimensional constellation. 
!n One bit of each data synODol is pre-coded, and the other is 
l| subjected to a l/2 encoding rate that produces two coded bits in 
^ accordance with a four (4) state trellis code. For purposes of 
ri interleaving, twelve (12) identical encoders and pre-coders operate 
successively on every twelve successive data symbols. Symbols 0, 
12, 24, 3 6, . . . are encoded as one series. Symbols 1, 13, 25, 
0 3 7, ... as a second series. Symbols 2, 14, 26, 38, . . . as a 
third series. And so on for a total of twelve (12) series. 
Therefore, the ATSC Standard requires twelve (12) trellis decoders 
in the HDTV receiver for the twelve (12) series of time division 
interleaved data symbols in the signal. Each trellis decoder in 
2 0 the HDTV receiver decodes every twelfth (12th) data symbol in the 
stream of coded data symbols . 

In an ATSC Standard receiver trellis decoders are used to 
retrieve the original digital data that was trellis encoded just 
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before being converted to 8-VSB symbols, modulated and broadcast. 
The use of trellis coding provides an improvement in the signal to 
noise ratio of the received signal, and the time multiplexing of 
twelve (12) independent streams reduces the possibility of co- 
5 channel interference from an analog NTSC broadcast signal residing 
on the same frequency. The abbreviation NTSC stands for National 
Television Standards Committee, 

Each of the trellis decoders for the four (4) state trellis 
:S code operates in accordance with the well-known Viterbi decoding 
if algorithm. Each of the decoders comprises a branch metric 
Q generator unit, an add- compare -select unit, and a path-memory unit. 

See, for example, "Trellis-coded Modulation With Redundant Signal 
□ Set, Part I, Introduction; Part II, State of the Art," by 
G. Ungerboeck, IEEE Communications Magazine, Vol. 25, pp. 5-21, 
as February 1987 . 

In addition to being corrupted by noise, the transmitted 
signal is also subject to deterministic channel distortions and 
distortions caused by multipath interference. Consequently, an 
adaptive channel equalizer is generally used in front of the 
20 trellis decoders to compensate for these effects. The goal is to 
create a symbol stream that resembles, as much as possible, the 
symbol stream that was created by the twelve (12) trellis encoders 
at the transmitter. 
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One commonly used equalizer architecture makes use of a second 
equalizer known as a decision feedback equalizer (DFE) . In this 
architecture, a conventional, or forward equalizer (FE) is 
supplemented by a DFE. The input to the DFE is an estimate of the 

5 original transmitted value of the current output symbol of the 
complete equalizer (FE and DFE) . The output of the decision 
feedback equalizer (DFE) is subsequently added to the output of the 
forward equalizer (FE) to generate the output symbol. In a typical 

:0 implementation, this estimate of the output symbol is obtained by 
M simply ^^slicing" the equalizer output. The term ^^slicing" refers 

^^J to the process of taking the allowed symbol value (of the eight (8) 
levels specified by the 8-VSB ATSC Standard) that is nearest to 

O that of the actual output. Using the ^^sliced" symbols in a decision 
feedback equalizer (DFE) gives a near optimum error rate 

ii performance with low complexity. This approach, however, can 
suffer from error propagation caused by slicing errors. Because the 
typical symbol error rate after the equalizer for the HDTV signal 
can be up to twenty percent (20%) , this can be a serious problem if 
the number of DFE filter taps is large. 

20 After the equalizer, the HDTV signal is decoded in a trellis 

decoder that uses the Viterbi algorithm to decode the symbol stream 
based on the 1/2 rate trellis coding performed in the transmitter. 
As previously mentioned, the ATSC Standard specifies that twelve 
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(12) trellis encoders and decoders are used in parallel in a time 
multiplexed fashion. Trellis decoding is then followed by byte de- 
interleaving and Reed Solomon decoding to further correct 
transmission errors in the signal. 

There is a need in the art for a system and method that will 
reduce error propagation in a decision feedback equalizer used in 
trellis coded systems in general and in ATSC VSB receivers in 
particular . 
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SUMMARY OF THE INVENTION 

To address the above-discussed deficiencies of the prior art, 
the system and method of the present invention reduces error 
propagation in a decision feedback equalizer in an ATSC VSB 
receiver by utilizing symbol stream information from a trellis 
decoder. The present invention provides an improved two stage 
trellis coded system for reducing error propagation. 

The output symbols from the adaptive channel equalizer are 
input to a trellis decoder. The trellis decoder uses ^^soft" 
decision making to determine the most likely symbol values that 
were originally transmitted as opposed to ^^hard" decision making 
such as ""slicing," Soft decision methods take into account the 
restricted set of values that the symibol following a symbol having 
a given value is permitted to assume by the trellis encoder. Soft 
decision methods use this additional information to obtain a more 
reliable estimate of the actual value than can be obtained by hard 
decision methods that only consider the current symbol. 

The system and method of the present invention uses 
information from the trellis decoder to generate an estimate of the 
equalizer output that serves as the input to the decision feedback 
equalizer (DFE) . The system and method of the present invention 
essentially incorporates a trellis decoder into the equalizer to 
provide the estimates of the actual symbol values that are needed 
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by the decision feedback equalizer (DFE) . Due to the nature of the 
Viterbi algorithm, which performs a trace-back over a path 
consisting of previously received symbols and having a specified 
length, an estimate is provided not only for the current symbol, 
but for all of the previous symbols that constitute this path. 
Since the Viterbi algorithm is known to provide the best estimate 
of the value of the transmitted symbol data under conditions of 
Gaussian channel noise, such an approach results in more reliable 
data being input to the decision feedback equalizer (DFE) than was 
possible using simple slicing of the equalizer output. This in 
turn results in better equalizer performance, and therefore in more 
reliable data being input to the trellis decoder, 

A related method uses a second equalizer, whose decision 
feedback equalizer (DFE) input is the output of this trellis 
decoder as well as the training sequence for the equalizer 
adaptation. Since the trellis decoder provides an optimum estimate 
of the symbol data, its output can be reliably used as a training 
sequence even though it is only an estimate and does not constitute 
a priori knowledge of the transmitted data, as is the case with a 
known training sequence. 

The ATSC trellis decoder system consisting of twelve (12) time 
multiplexed Viterbi decoders is fairly complicated and requires a 
substantial amount of hardware to implement. Also, an adaptive 
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channel equalizer is, in general, the most complicated component of 
a digital data demodulator in terms of the amount of hardware 
required to implement it. It is also therefore the most expensive 
component . 

A trellis decoder in accordance with the principles of the 
present invention is adapted for decoding each of a plurality of 
interleaved series of data symbols, each series having been trellis 
encoded in accordance with a multi-level constellation of 
permissible trellis code values. Such a decoder comprises a branch 
metric generator for deriving for each series the branch metrics of 
^^1 each of the trellis states as successively determined for 
'3 successive data symbols in such series. The branch metric and 
Qi trellis state information is supplied to an add-compare- select 
(ACS) unit which determines the best metric paths which are 
l3 successively updated for each series in accordance with 
successively received data syrrbols in each series. The decoder 
also comprises successive path memory stages, the outputs of each 
stage being the inputs of the next succeeding stage, each stage 
receiving from its predecessor and storing a pointer identifying 
the path having the best metric through the trellis for the 
previously received data symbol in each of said series, the first 
stage receiving from the ACS unit and storing a pointer identifying 
the path having the best metric through the trellis for currently 



20 
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received data symbols in each of said series. The final memory 
stage thereby will have stored therein a pointer for the trellis 
states corresponding to the earliest of the data symbols in each of 
the series of stored trellis states in all of the path memory 
stages, from which trellis states the fully decoded value of said 
earliest data symbol is indicated. 

According to one feature of the present invention, the decoder 
makes use of the fact that for certain trellis codes, including the 
four (4) state code of the ATSC Standard, the trellis states can be 
divided into a plurality of distinct groups such that the states 
existing at any time in a given group can only have resulted from 
preceding trellis states within that same group. In addition, any 
existing state can only have resulted from a small number 
of possible predecessor states. Codes having both those 
characteristics are called "well-defined" codes. In particular, 
for a larger number of well-defined codes, the number of possible 
predecessor states depends on the number of trellis coded input 
bits. That number is one in the ATSC Standard and in the majority 
of trellis codes presently in use, and hence the number of possible 
predecessor states in those codes is only two. The four (4) state 
trellis code of the ATSC Standard is an example of a well-defined 
code, whereby it is possible to provide two ACS sub-units to 
respectively derive best metric path data for only the two trellis 
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states in respective ones of first and second groups. Each such 
ACS sub-unit is thereby much simpler in design and operation that 
would be a single ACS unit for both of said groups. This approach 
can be taken for well-defined codes of any number of states. For 
example, with an eight (8) state code there may be four groups of 
two (2) states each, and four ACS units would each handle one such 
group . 

According to a further feature of the present invention, the 
path memory unit is constituted by successive storage sections in a 
single random access memory (RAM) , as the simplification of the 
path memory unit reduces the required input/ output by a similar 
amount . 

Another feature of ''well-defined" codes that is exploited in 
the present invention is the simplification of the path memory 
required for each state of the trellis code. Since any existing 
state could have been reached from only a small number '^s'^ of 
possible predecessor states, it is not necessary to store a pointer 
to all possible predecessor states. Instead, a pointer is stored 
which distinguishes between the small set of possible predecessor 
states. This requires only a number of memory elements at least 
equal to log2 s. Use is made of the information identifying the 
particular sets to clearly determine the pointer to the previous 
state. This implies that a small penalty may be paid in terms of 
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extra logic required to determine the pointer to the previous 
state. However, the second condition of the well-defined code, 
namely that of distinct groups of code states such that those 
existing at any time in a given group can only have resulted from 
previous states in that same group, ensures that the extra logic is 
actually simpler than would be required to implement a conventional 
path memory unit. Such simplification can achieve a reduction by a 
factor of two in regard to the memory required for the four (4) 
state ATSC code, and reduction by a factor of three in the case of 
an eight (8) state code. The saving in memory capacity is therefore 
substantial . 

A further feature of the present invention which is specific 
to the four (4) state ATSC code is that the path memory logic 
required for selection of a pointer among possible predecessor 
states at every stage is simplified so that the propagation delay 
in the combinatorial logic required for computation of each 
traceback portion of the overall path is reduced by a factor of 
two. This has significant advantages in regard to the speed at 
which the trellis decoder can be operated and results in fewer 
logic elements. 

An HDTV receiver in accordance with the present invention is 
adapted to receive a digital HDTV signal having successive data 
frames each of which includes successive data segments, each 
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segment including successive data symbols, the data symbols being 
interleaved to form a plurality of data streams which are each 
trellis encoded in accordance with a code having a multi- level 
constellation of permissible code values. Such receiver includes a 
trellis decoder as described above , 

It is an object of the present invention to provide a system 
and method for reducing errors in a decision feedback equalizer in 
an ATSC VSB receiver by utilizing symbol stream information from a 
trellis decoder. 

It is another object of the present invention to provide a 
system and method for decoding ^'best guess" values for symbols in a 
trellis decoder. 

It is also an object of the present invention to provide a 
system and method that sends ''best guess'' values for symbols from a 
trellis decoder to decision feedback equalizer in an ATSC VSB 
receiver. 

It is another object of the present invention to provide a 
system and method for performing channel equalization in an ATSC 
VSB receiver with a decision feedback equalizer that uses ''best 
guess" values for symbols from a trellis decoder. 

It is also an object of the present invention to provide a 
system and method for reducing errors in a decision feedback 
equalizer in an ATSC VSB receiver by utilizing a first combination 
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of a first equalizer unit and a first trellis decoder and a second 
combination of a second equalizer unit and a second trellis 
decoder . 

The foregoing has outlined rather broadly the features and 
5 technical advantages of the present invention so that those skilled 
in the art may better understand the detailed description of the 
invention that follows. Additional features and advantages of the 
invention will be described hereinafter that form the subject of 
IS; the claims of the invention. Those skilled in the art should 
IS appreciate that they may readily use the conception and the 
r\ specific embodiment disclosed as a basis for modifying or designing 
;5 other structures for carrying out the same purposes of the present 
'■^^ invention. Those skilled in the art should also realize that such 
r'l equivalent constructions do not depart from the spirit and scope of 
ll the invention in its broadest form. 

Before undertaking the Detailed Description of the Invention, 
it may be advantageous to set forth definitions of certain words 
and phrases used throughout this patent document: the terms 
"include" and ''comprise" and derivatives thereof; mean inclusion 
20 without limitation; the term "or," is inclusive, meaning and/or; 
the phrases "associated with'' and "associated therewith," as well 
as derivatives thereof, m.ay mean to include, be included within, 
interconnect with, contain, be contained within, connect to or 
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with, couple to or with, be communicable with, cooperate with, 
interleave, juxtapose, be proximate to, be bound to or with, have, 
have a property of, or the like; and the term "controller,'' 
"processor," or '^apparatus" means any device, system or part 
5 thereof that controls at least one operation, such a device may be 
implemented in hardware, firmware or software, or some combination 
of at least two of the same. It should be noted that the 
functionality associated with any particular controller may be 
centralized or distributed, whether locally or remotely. In 
Ifl particular, a controller may comprise one or more data processors, 
=3 and associated input/output devices and memory, that execute one or 
more application programs and/or an operating system program. 
O Definitions for certain words and phrases are provided throughout 
\lh this patent document. Those of ordinary skill in the art should 
15 understand that in many, if not most instances, such definitions 
apply to prior, as well as future uses of such defined words and 
phrases . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, 
and the advantages thereof, reference is now made to the following 
descriptions taken in conjunction with the accompanying drawings, 
wherein like numbers designate like objects, and in which: 

FIGURE 1 illustrates a block diagram of an exemplary high 
definition television (HDTV) transmitter; 

FIGURE 2 illustrates a block diagram of an exemplary high 
definition television (HDTV) receiver; 

FIGURE 3 illustrates s a block diagram of a trellis encoder 
comprising twelve (12) parallel trellis encoder and pre-coder units 
for twelve groups of interleaved data symbols; 

FIGURE 4 illustrates a block diagram of one exemplary trellis 
encoder and pre-coder unit (one of the twelve (12) such units shown 
in FIGURE 3) and an eight (8) level symbol mapper; 

FIGURE 4A illustrates the four subsets a, b, c, d of the 
constellation code values R; 

FIGURES 5A, 5B, and 5C illustrate respectively a trellis 
diagram, a state diagram, and a trellis code value tabulation 
applicable to the exemplary ATSC trellis encoder shown in FIGURE 4; 

FIGURE 6 illustrates a block diagram of an exemplary ATSC 
trellis decoder; 
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FIGURE 7 illustrates a block diagram of an adaptive channel 
equalizer comprising a forward equalizer (FE) filter and a decision 
feedback equalizer (DFE) filter; 

FIGURE 8 illustrates a block diagram of an adaptive finite 
impulse response (FIR) filter for use in an adaptive channel 
equalizer; 

FIGURE 9 illustrates a block diagram of the present invention 
showing the connection of a forward equalizer (FE) filter to a 
trellis decoder and the connection of the trellis decoder to a 
decision feedback equalizer (DFE) filter; 

FIGURE 10 illustrates a block diagram of the present invention 
showing in more detail the connection of the trellis decoder to the 
decision feedback equalizer (DFE) filter; 

FIGURE 11 illustrates a block diagram showing a combination of 
a first equalizer and a first trellis decoder and a combination of 
a second equalizer and a second trellis decoder; 

FIGURE 12 illustrates a flow diagram showing an advantageous 
embodiment of the method of the present invention; 

FIGURE 13 illustrates a block diagram showing an advantageous 
embodiment of the two stage equalizer of the present invention; 

FIGURE 14 illustrates a block diagram showing an advantageous 
embodiment of the two stage equalizer of the present invention in a 
less complex form; and 
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FIGURE 15 illustrates a block diagram showing an advantageous 
embodiment of one implementation the two stage equalizer of the 
present invention . 
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DETAILED DESCRIPTION OF THE INVENTION 

FIGURES 1 through 15; discussed below, and the various 
embodiments used to describe the principles of the present 
invention in this patent document are by way of illustration only 
and should not be construed in any way to limit the scope of the 
invention. In the description of the exemplary embodiment that 
follows, the present invention is integrated into, or is used in 
connection with, a high definition television system. Those skilled 
in the art will recognize that the exemplary embodiment of the 
present invention may easily be modified for use in other similar 
types of systems for modulating and demodulating digital data. 

FIGURE 1 illustrates a block diagram of an exemplary high 
definition television (HDTV) transmitter 100. MPEG compatible data 
packets are encoded for forward error correction (FEC) by a Reed 
Solomon (RS) encoder 110. The data packets in successive segments 
of each data field are then interleaved by data interleaver 12 0, 
and the interleaved data packets are then further interleaved and 
encoded by trellis encoder unit 130. Trellis encoder unit 130 
produces a stream of data symbols representing three (3) bits for 
each symbol. One of the three bits is pre-coded and the other two 
bits are produced by a four (4) state trellis encoding. 

As will be more fully discussed, trellis encoder unit 130 
comprises twelve (12) parallel trellis encoder and pre-coder units 
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to provide twelve interleaved coded data sequences. The encoded 
three (3) bits of each trellis encoder and pre-coder unit are 
combined with field and segment synchronization bit sequences in 
multiplexer 140. A pilot signal is inserted by pilot insertion 
unit 150. The data stream is then subjected to vestigial sideband 
(VSB) suppressed carrier eight (8) level modulation by VSB 
modulator 160 . The data stream is then finally up -converted to 
a radio frequency by radio frequency (RF) by converter 170. 

FIGURE 2 illustrates a block diagram of an exemplary high 
definition television (HDTV) receiver 200. The received RF signal 
is down- converted to an intermediate frequency (IF) by tuner 210. 
The signal is then filtered and converted to digital form by IF 
filter and detector 220, The detected signal is then in the form 
of a stream of data symbols that each signify a level in an eight 
(8) level constellation. The signal is then filtered by NTSC 
rejection filter 230 and subjected to equalization and phase 
tracking by equalizer and phase tracker unit 240. The recovered 
encoded data symbols are then subjected to trellis decoding by 
trellis decoder unit 250. The decoded data symbols are then 
further de-interleaved by data de-interleaver 260. The data 
symbols are then subjected to Reed- Solomon decoding by Reed Solomon 
decoder 270. This recovers the MPEG compatible data packets 
transmitted by transmitter 100. 
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FIGURE 3 illustrates how the interleaved data from data 
interleaver 12 0 are further interleaved during the trellis encoding 
process. Demultiplexer 310 of trellis encoder unit 130 distributes 
each successive series of twelve (12 ) data symbols among twelve 
5 (12) successive trellis encoder and pre-coder units 320A, 320B, 
320C, 320K, and 320L. The encoded outputs of the twelve (12) 

successive trellis encoder and pre-coder units are then time 
division multiplexed by multiplexer 330 to form a single data 

Ipi! stream. The single data stream is sent to eight (8) level symbol 

$3 mapper 430 of trellis encoder unit 130. 

Q FIGURE 4 illustrates a block diagram of an exemplary trellis 

encoder and pre-coder unit 320A and its output to eight (8) level 
i^^i symbol mapper 430. Not shown in FIGURE 4 is multiplexer 330 that 
\^ couples trellis encoder and pre-coder unit 320A to eight (8) level 
ig symbol mapper 430. Trellis encoder and pre-coder unit 320A 
comprises pre-coder 410 and trellis encoder 420. Each data symbol 
to be encoded comprises two bits, Xi and X2 . Bit X2 is pre-coded by 
pre-coder 410 which comprises a one bit register 440 to derive pre- 
coded bit Y2. Bit Y2 is not altered further by trellis encoder 420 
20 and is output as bit Z2 . 

The other input bit, Xi, does not pass through pre-coder 410, 
Bit Xi (also denoted bit Yi) does pass through trellis encoder 420. 
Trellis encoder 420 encodes bit Xi in accordance with a rate 1/2 
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trellis code utilizing one bit data registers 450 and 460. 
The result is output as bit Zq and bit Zi . Therefore, three bits 
(i.e., bit Zo, bit Zi, and bit Z2) are output by trellis encoder 420 
to eight (8) level symbol mapper 430. Eight (8) level symbol mapper 
5 43 0 converts the three bits to a value R in an eight (8) level 
constellation of permissible code values. The permissible code 
values for R are -7, -5, -3, -1, +1, +3, +5, and +7. These values 
correspond with the three bit combinations shown in eight (8) level 
^yi symbol mapper 430. 

lo The above described process is carried out for each of the 

"J twelve interleaved series of data symbols. Eight (8) level symbol 
mapper 43 0 comprises a look-up table for selecting the correct R 
code value for a given set of three input bits. It is seen that 
the eight (8) level constellation has four possible subsets of bits 
Zi and Zor each subset having dual possible constellation values 
depending whether the pre-coded bit Z2 is a zero (^^0^^) or a one 
( Those subsets and the corresponding constellation values are 
shown in FIGURE 4A. Further details of the encoder and its 
operation are given in Appendix D of the ATSC Standard. For a 

20 basic description of the logic operations involved in trellis 
encoding and decoding, refer to ^'Principles of Communication 
Systems/' by H. Taub et al . , 2""^ edition, pp. 562-571, McGraw Hill, 
New York, 1986. 
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To understand how a single trellis decoder can decode twelve 
interleaved series of data symbols obtained from an HDTV signal, 
refer to the four (4) state trellis diagram in FIGURE 5A. 
FIGURE 5A and the corresponding state diagram in FIGURE 5B ignore 
5 pre-coder 410 in FIGURE 4 which supplements trellis encoder 420, 
because the pre- coding has a very simple inverse that is described 
in the ATSC Standard. The trellis diagram in FIGURE 5A relates to 
the successive values of uncoded bit Xi in FIGURE 4 in successive 
D symbol periods. The two active registers, 450 and 4 60, have bit 
li values which during any symbol period determine the four (4) 
;y possible code states ^^00", "01", ^^10", "11'^. If the next Xi bit is 
a zero ("0"), the present code state will change to the succeeding 
O state indicated by the solid line leaving the present state, and if 
the Xi bit is a one ("1")/ the present state will change to the 
ft succeeding state indicated by a dashed line leaving the present 
state. The output of the decoder is the Zi, Zq subset indicated in 
each case at the end of the state change line. 

Thus, for example, if the present code state Di, Do is "01'" and 
the next Xi bit is a zero ("0"), then the next code state Di, Do 
2 0 will be ''10" and the Zi, Zq output subset of the decoder will be 
"01". The pre-coded bit Z2 received by the decoder serves, as 
described above, to distinguish between the two possible outputs 
that can result from each transition between trellis states. The 
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possible coded output subsets Zi, Zq resulting from uncoded input 
bit Xi, and the possible transitions between the present (PS) and 
next (NS) code states Di, Do are shown in the table in FIGURE 5C, 
For any given code state (i.e., the values Di, Dq of the bits in 

5 registers 450 and 460) only two possible transitions can be 
produced by the input bit Xi, depending on whether it is a zero 
(^^0^') or a one ("1") . As seen in FIGURE 5A, given a particular 
initial code state Di, Do (which is typically ^^00") a specific 
sequence of input bits Xi will select a particular path through the 

M trellis diagram. There are four possible values of output Zi, Zq, 
constituting the above-mentioned four subsets a, b, c and d shown 

W in FIGURE 4A and also marked on the state transition lines in 

^3 FIGURE 5A. The code states and possible transitions are also shown 
in the state diagram in FIGURE 5B. Each transition line therein is 
marked with 

( Xi ) / ( Zi Zo ) (1) 
where Xi is the input bit value and Zi Zq is the resulting coded 
output subset . 

A trellis decoder must reconstruct a transmitted sequence of 
20 data symbols from a received noise- corrupted encoded version of the 
transmitted sequence. The first step is to identify the code 
subset signified by a received symbol. Selection of the nearest of 
the two constellation points corresponding to that subset is then 
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made by passing the received symbol through a detector having a 
threshold set at a level exactly halfway between the two 
constellation points. In this way an accurate determination can be 
made as to the encoded symbol that was transmitted. 
5 To evaluate a received sequence of coded symbols, the paths 

through the trellis diagram must be accurately determined. 
Essentially, from among all possible paths that exist through the 
trellis diagram the one that comes "closest" to the actual received 
^0 symbol sequence must be selected. While this might initially seem 
iM to require an inordinate number of calculations, a significant 
simplification is achieved by making use of the Viterbi algorithm. 
■3 This is described in the text ''Principles of Digital Communication 
'"^^ and Coding,'' by Viterbi et al . , McGraw Hill, New York, 1979. 

According to the Viterbi algorithm, the number of surviving paths 
±6 at every stage of the trellis decoding process is equal to the 
total number of trellis states of the trellis code. That is, only 
one surviving path, consisting of the closest match to the actually 
received sequence, is continued to the following state of the 
trellis. This is based on the observation that the match between a 
2 0 received sequence and a specific branch in the trellis can be 
described in terms of a metric, and the branch metrics are 
additive. The cumulative metric of a path is called the path 
metric, and is the sum of all of the branch metrics of that path. 
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Each branch metric corresponds to the difference between the output 
corresponding to a specific branch within the trellis diagram in 
FIGURE 5A and the actual received symbol value corresponding to 
that branch. 

5 Accordingly, a Viterbi decoder requires a branch metric 

generator (BMG) unit which calculates a distance (''branch metric'O 
in each bit period between a received bit value and the bit values 
of all the trellis paths leading up to the code state existing 
'£j during that bit period. The branch metrics are supplied to an add- 
ii compare- select (ACS) unit that maintains the accumiulated path 
metrics, one for each of the code states. The ACS unit also 
determines, for each successive new code state, the path having the 
■■^ minimum (i.e., best) path metric to that state and this path is 
■I^; selected and stored in the form of a pointer in a path memory unit 
(PMU) defining the new path to that code state. That constitutes 
the most likely (survivor) trellis path to that code state. 
Finally, a traceback unit traces back along the accumulated 
survivor paths to thereby determine the sequence of bits 
constituting the most likely transmitted data sequence. The number 
2 0 of traceback steps is called the decoding depth, and the oldest bit 
on the traceback path is output as a decoded bit. The traceback 
unit must therefore store the aforesaid number of most recent 
traceback steps, which are in the form of pointers or "decision 
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vectors . 

In accordance with the aforesaid description, for every 
destination state (on the right side of FIGURE 5A) the ACS unit 
must determine the appropriate branch metric to add to the already 
accumulated path metric going back to the preceding states that end 
in that destination state, and then select as the surviving path 
the one having the smallest resultant path metric. 

Note that a description of the state transitions which result 
in the surviving path must be stored following each successive 
received symbol in a sequence. This consists of the accumulated 
path metric leading up to the present state, and also the precise 
sequence of transitions between all previous states in order to 
arrive at the present state. Clearly, it is impossible to store 
all possible transitions leading to a given state. A sub-optimal 
solution is to store all transitions up to a specified number of 
states preceding the present state. The trellis state transition 
corresponding to the pointer stored in the path memory unit (PMU) 
corresponding to the earliest branch which has resulted in the best 
metric among all the states existing at the current transition is 
then used to determine the decoded symbol. Such decoded symbol is 
described by identifying the pre-coded bit and also which of the 
subsets a, b, c, or d correspond to the encoded bit as described 
above. This trellis decoding strategy is well known and is 
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described in the above -referenced textbook by Viterbi and also in a 
technical paper entitled "A Programmable Parallel Processor 
Architecture For A Viterbi Detector," by H. Lou et al . , Globecom, 
1990 . 

The transition history of each surviving path metric is stored 
in the path memory unit (PMU) . A simplified implementation of the 
PMU which separates memory-based functions from logic functions 
thereof is described in a technical paper entitled '^Memory 
Management in a Viterbi Decoder/' by C . M. Rader, IEEE Trans. 
Comms.; Vol, Com~29, No. 9, September 1981. Basically, the idea is 
to compute the past state transition sequence best corresponding to 
the present state. What then needs to be stored for every state is 
a selective pointer to the best corresponding previous state. 
These pointers can then be sequentially used to identify the 
selected branch at the earliest stage of the PMU and consequently 
the initial decoded symbol in the complete sequence. 

FIGURE 6 illustrates a block diagram of an exemplary ATSC 
trellis decoder 250. Trellis decoder unit 250 comprises a branch 
metric generator (BMG) unit 610, an add-compare-select (ACS) unit 
62 0, a path memory unit (PMU) 63 0, a traceback unit 64 0, and a 
subset bit delay unit 650. Trellis decoder unit 250 also comprises 
a subset bit multiplexer 670 and an output decode logic unit 680, 
The terms ''met a", ''met_b" , ''met_c" , and '^met__d" in branch metric 
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generator (BMG) unit 610 refer to a branch metric for the current 
input symbol corresponding to each subset (a, b, c, d) . The terms 
"sub a." , ''sub_b'\ ''sub_c'' , and ''sub_d" in branch metric generator 
(BMG) unit 610 refer to a subset (uncoded) bit for the current 
5 input symbol corresponding to each subset (a, b, c, d) , The terms 
"svrO", "svrl", "svr2'\ and "svr3" in add-compare-select (ACS) unit 
620 refer to a pointer to the previous trellis state for the 
survivor path corresponding to each possible current state. The 
^fl term ^'SVR" in add-compare-select (ACS) unit 62 0 refers to the 
li survivor path with the lowest cumulative metric. The pointers 
'^J "svrO", "svrl", ''svr2", and ''svr3" to the previous state in each 
ffl survivor path may be implemented using one (1) or two (2) bits 
■■^f each. 

^'2 It is understood the component elements of trellis decoder 

S unit 250 described herein are exemplary only, and that from the 
functional descriptions given herein it will be apparent to those 
skilled in the art that various logic circuit implementations of 
each of these component elements of trellis decoder unit 250 can be 
employed. 

20 The input to the BMG unit 610 is a digitized baseband data 

symbol stream resulting from demodulation and detection of the 
transmitted eight (8) level VSB signal described above with 
reference to the digital receiver in FIGURE 2 . Each symbol in the 
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Stream, in the ideal case of perfect transmission with no channel 
distortion or noise, will be at one of the eight (8) discrete 
levels that make up the constellation of the 8-VSB demodulator, as 
shown by the symbol mapper 430 in FIGURE 4. In reality, however, 
noise in the transmission channel affects the value of each symbol . 
If the noise is very low, the detected symbol value (three (3) 
bits} will be closer to the level of the actually transmitted 
symbol than to any of the other seven (7) levels, and so in 
principle could be obtained by simple eight (8) level slicing. If 
the noise level exceeds a certain value, however, the detected 
symbol level may be closer to an incorrect one of the eight (8) 
constellation values. It is under these conditions that trellis 
encoding, wherein the value of each encoded symbol depends on 
present as well as previous symbol values , achieves significant 
improvement of the receiver bit error rate., 

FIGURE 7 illustrates a block diagram of a prior art adaptive 
channel equalizer 700 for use in equalizer and phase tracker unit 
240. Prior art adaptive channel equalizer unit 700 comprises a 
forward equalizer (FE) filter 710 and a decision feedback equalizer 
(DFE) filter 720. The output from forward equalizer (FE) filter 
710 is added to the output from decision feedback equalizer (DFE) 
filter 72 0 in adder unit 730 to form the output of adaptive channel 
equalizer unit 700. 
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Forward equalizer (FE) filter 710 accepts the uncompensated 
channel symbol data as its input. In contrast, decision feedback 
equalizer (DFE) filter 72 0 requires for its input an "estimate" of 
the symbol that was transmitted over the channel before the symbol 
was corrupted by noise. 

As is well known, DFE filter 72 0 can receive an estimate of 
the output symbol by simply "slicing" the equalizer output. The 
term "slicing" refers to the process of taking the allowed symbol 
value (of the eight (8) levels specified by the 8-VSB ATSC 
Standard) that is nearest to that of the actual output. In the 
embodiment shown in FIGURE 1, level slicer 74 0 provides the 
"sliced" symbols to DFE filter 720 through multiplexer 750. This 
method of providing estimates of the output symbols to DFE 
filter 720 can suffer from error propagation caused by slicing 
errors , 

As is also well known, DFE filter 72 0 can be adapted either in 
a "trained mode" or in a "blind" mode. In the "trained mode" 
DFE filter 720 receives a "training sequence" of known symbols 
(through multiplexer 750) at a certain known time. DFE filter 720 
compares the known training sequence with the "equalizer error for 
trained adaptation." The equalizer error for trained adaptation is 
obtained by subtracting the equalizer output from the known 
training sequence. DFE filter 720 then adjusts its operation to 
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cause the equalizer output to match the known sequence of training 
signals . 

Alternatively, DFE filter 72 0 can operate in a "blind mode." 
In the ^^blind mode" DFE filter 72 0 receives an "equalizer error for 
5 blind adaptation" from blind error unit 760. Blind error unit 760 
compares the equalizer output with an expected statistical 
distribution of the data to generate the equalizer error blind 
adaptation. DFE filter 720 then adjusts its operation to cause the 
^0 equalizer output to match the expected statistical distribution of 
11 the data. 

'^^-1 FIGURE 8 Illustrates a conventional adaptive finite impulse 

■'5 response (FIR) filter 800 for use in forward equalizer (FE) filter 
710 and in decision feedback equalizer (DFE) filter 720. The 
coefficients of FIR filter 800 are computed to compensate as much 

B as possible for channel distortions. The length of FIR filter 800 
corresponds to the maximum impairment delay that FIR filter 80 0 is 
designed to correct for. 

FIR filter 800 comprises a number of filter tap cells 810 
(also referred to as ^^filter taps"). Each filter tap 810 comprises 

20 a data storage register 820, a coefficient storage register 830, 
and multiplier 840. The output of multiplier 840 is input to an 
adder unit 850. Adder unit 850 sums all of the weighted tap values 
to generate a filter output. Filter tap 810 also comprises a 
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coefficient adaptation unit 860 that computes the updated filter 
coefficients. The coefficient adaptation unit 860 has the 
following inputs: (1) the current coefficient value, (2) the 
data tap value, and (3) a measure of the equalizer error (i.e., 
5 ' the difference between the expected signal value and the actual 
output signal value) , The coefficient adaptation unit 860 operates 
only when the adaptation process is being performed. 

A commonly used method of computing the filter coefficients 
;0 uses the well known least mean square (LMS) algorithm. The LMS 
il algorithm is a successive approximation technique that uses the 
'^j, current coefficient and data tap values as well as the equalizer 
error to compute the new coefficient value. The LMS algorithm 
repeats the procedure until each filter coefficient converges to 
;^ the desired optimum value. 

In a typical LMS algorithm the coefficient vector is 
determined using the following formula: 

Cn^l = Cn + M E dn (2) 

where Cn is the coefficient vector at time n, ^ is an adaptation 
speed constant, and dn is the data vector in the filter at time n. 
2 0 E is the error calculated from the output of the equalizer. E can 
be calculated in a decision directed fashion using the known 
training sequence embedded in the data stream. Alternatively, 
E can be calculated in a blind fashion using a CMA algorithm. 
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The abbreviation CMA stands for "constant modulus algorithm." 

FIGURE 9 illustrates a block diagram of the present invention 
showing the connection of forward equalizer (FE) filter 710 to 
trellis decoder 250 and the connection of trellis decoder 250 to 
5 decision feedback equalizer (DFE) filter 720. The output from 
forward equalizer (FE) filter 710 is added to the output from 
decision feedback equalizer (DFE) filter 720 in adder unit 730 to 
form the input to trellis decoder 250. The path memory outputs 
^0 from trellis decoder 250 are fed back to decision feedback 
l| equalizer (DFE) filter 720. As will be more fully explained, 
'^i information from the path memory outputs is used to reduce errors 
^3 in decision feedback equalizer (DFE) filter 720. 

^3 The ATSC standard specifies a rate 1/2 code trellis decoder 

where the symbols are interleaved into twelve (12) different 

H trellis decoders. The ATSC standard specifies path memory output 
lengths from twelve (12) symbols to sixteen (16) symbols. Thus, 
in presently available ATSC trellis decoder embodiments a path 
memory of twelve (12) to sixteen (16) delays is typically used 
before symbol decisions are made. When combined with the 

2 0 interleaving, the delay amounts to a latency of one hundred forty 
four (144) symbols (i.e., twelve (12) delays times twelve (12) 
symbols) to one hundred ninety two (192) symbols (i.e., sixteen 
(16) delays times twelve (12) symbols) . With these latencies, the 
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output of the trellis decoder is of little use to the decision 

feedback equalizer (DFE) filter. 

However, in the present invention, after each path memory 

stage in trellis decoder 250, a "best guess" for each symbol can be 
5 generated that will have a lower probability of error than the 

^^hard" decisions made on the eight (8) level equalizer output. 

These '^best guesses'' can be fed back into DFE filter 72 0 as soon as 

they are available. 

Trellis decoder 250 simultaneously makes available the entire 
M traceback path for one of the twelve (12) trellis coded data 
•4 streams. In every stage of the traceback memory in trellis decoder 
■-^ 250 a branch metric and a survivor path are available from which a 
O symbol can be decoded. The "best guess" for each symbol can serve 

as an improved "estimate'' for the symbol to be provided to DFE 

t4 filter 720 . 

Therefore, when the path memory length is sixteen (16) , 
trellis decoder 2 50 can provide current information concerning the 
most recent sixteen (16) symbols. Information concerning the first 
(or earliest) symbol of the set of sixteen (16) symbols will be 

2 0 accurate because that symbol will have been fully decoded. The 
current information concerning the remaining fifteen (15) symbols 
of the set will not be as accurate as it will become after the 
remaining fifteen (15) symbols are fully decoded. But the current 
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information concerning the remaining fifteen (15) symbols of the 
set will be more accurate than the information available from the 
^^hard"' slicer decisions available using prior art methods. 

FIGURE 10 illustrates a block diagram showing in more detail 

5 the connection of the trellis decoder 250 to the decision feedback 
equalizer (DFE) filter 720. Forward equalizer (FE) filter 710 is a 
filter having M taps. Decision feedback equalizer (DFE) filter 720 
is an equalization filter having N taps. Branch metric generator 

= 3 (BMG) unit 610 and add-compare-select (ACS) unit 620 of trellis 

li decoder 250 are shown in FIGURE 10 as trellis decoder unit 1010. 

As previously described, the output from forward equalizer 

^'^ (FE) filter 710 is added to the output from decision feedback 
equalizer (DFE) filter 720 in adder unit 730 to form the input to 

^'Z trellis decoder unit 1010. Least mean square (LMS) calculation 

jri unit 1020 also receives a copy of the input to trellis decoder unit 
1010. Path memory unit (PMU) 630, traceback unit 640, and subset 
bit delay unit 650 are represented schematically in FIGURE 10 as 
consecutive stages. In particular, the stages comprise stage 
number one (No. 1) 1030, stage number two (No. 2) 1040, stage 

20 number three (No. 3) 1050, . . . , and stage number X (No. X) 1060. 
In the ATSC standard, the value X typically takes on the values 
twelve (12) or sixteen (16) . 

As shown in FIGURE 10, a path memory output from each ^of the 
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X stages is connected to a tapped delay line (TDL) of N tap DFE 
filter 720. Each stage provides twelve (12) symbol inputs (one 
symbol input for every twelve (12) symbols for the ATSC standard) . 
Each of the tapped delay lines (TDL) is coupled to a respective 
5 multiplier having respective data tap coefficients C [0:11], 
C [12:23], C [24:35], . . . , C [12(X-1):N]. The outputs of the 
respective multipliers are summed in adder unit 1070. The output 
of the adder unit 1070 is fed bacl^ to adder unit 730. 
:|j In this manner, N tap DFE filter 720 receives an improved 

If estimate or "best guess" for each symbol in the trellis decoder 
''^^ symbol stream. The improved estimate has a lower probability of 
ilj error than the "hard" slicer decisions available using prior art 
methods . 

■^f FIGURE 11 illustrates a block diagram of the present invention 

S showing a combination of a first equalizer unit 1110 and a first 
trellis decoder 1120 and a combination of a second equalizer unit 
1140 and a second trellis decoder 1150. First equalizer unit 1110 
comprises a forward equalizer (FE) and a decision feedbaclc 
equalizer (DFE) of the type previously described. Second equalizer 
20 unit 1140 comprises a forward equalizer (FE) and a decision 
feedback equalizer (DFE) of the type previously described. 

In this embodiment of the present invention, a first equalizer 
and trellis decoder combination is used to estimate the symbol 
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stream, and (2) then the received symbol stream is used in a second 
equalizer and trellis decoder combination. First trellis decoder 
1120 operates on the output of the first equalizer unit 1110, 
After throughput latency of the first trellis decoder 1120 
5 (i.e., approximately twelve (12) times the trace back depth) hard 
decisions are output. 

In a parallel path the first equalizer unit 1110 and the first 
trellis decoder 1120, data is buffered in a "first in, first out" 
^5 buffer 1130. Buffer 1130 compensates for the latency of the first 
ii equalizer unit 1110 and the first trellis decoder 1120. 
,2 The channel distorted symbols from buffer 113 0 are then fed to the 
second equalizer unit 1140. The adaptation of the second equalizer 
unit 1140 uses a different error metric than the first equalizer 
1:1 unit 1120. The error is calculated using the hard decisions from 
Xi the first trellis decoder 1120. In this manner, the second 
equalizer unit 1140 can run in a data based decision directed mode. 
In addition, the decision feedback equalizer (DFE) portion of 
the second equalizer unit 1140 can use the hard decisions from 
first trellis decoder 1120 as input to minimize error propagation 
20 in the second equalizer unit 1140. Further, because reliable "best 
guesses" are available from second trellis decoder 1150, they can 
be fed back into the decision feedback equalizer (DFE) portion of 
the second equalizer unit 1140 to further minimize error 
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propagation. The hard decision output of second trellis decoder 
1150 is then fed to data de-interleaver 260 and then to a Reed 
Solomon decoder as specified in the ATSC standard. 

FIGURE 12 illustrates a flow diagram showing an advantageous 
5 embodiment of the method of the present invention. The steps of 
the method are collectively referred to with the reference numeral 
1200. Each of the X path memory unit outputs of trellis decoder 
25 0 are connected to the inputs of X filter tap cells in DFE 
'O filter 720 (step 1210) . In each stage (stage number one (No. 1) 
i| 1030, stage number two (No. 2) 1040, etc.) of path memory unit 630 
^ of trellis decoder 250, a symbol is decoded that represents the 
"best guess" value for the symbol (step 1220) . 

Each of the X decoded "best guess" symbols is sent to the 
Lj^ respective inputs of the X filter tap cells in DFE filter 720 
H (step 123 0) . DFE filter 72 0 uses the X decoded "best guess" symbol 
values as estimates to perform channel equalization (step 1240) . 
The process is continued for each of the subsequent set of X 
symbols that appears in the path memory unit 630 of trellis decoder 
250 (step 1250) . 

It is necessary that trellis decoder 250 be capable of 
providing the entire survivor path that corresponds to the current 
input symbol. In particular, the sequence of symbols that 
constitute this path will be fed back to DFE filter 720. 



20 
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The sequence of symbols can be reconstructed from the state 
transition and uncoded bit information stored in the corresponding 
path memories . 

FIGURE 13 illustrates a block diagram of an advantageous 
5 embodiment of the two stage equalizer 13 00 of the present 
invention. Two stage equalizer 1300 generally comprises a first 
stage equalizer (EQl) 1310 and a second stage equalizer (EQ2) 1320, 
First stage equalizer (EQl) 1310 comprises a forward equalizer 
^fl filter (FEl) 710, a decision feedback equalization filter (DFEl) 
ig 720, a trellis decoder 250, and an adder unit 730. Second stage 
equalizer (EQ2) 1320 comprises forward equalizer filter (FE2) 1350, 
decision feedback equalization filter (DFE2) 1340, and adder unit 
^zf 1360. 

Let Rk represent the input to the first stage equalizer (EQl) 
jr| 1310. Let the number (Nl + 1) be the number of taps in forward 
equalizer filter (FEl) 710. The filter coefficients of forward 
equalizer filter (FEl) 710 at time k are f^ = {f^o/ f\/ •■. . f^Ni} - 
The output of forward equalizer filter (FEl) 710 at time k is Bk- 
Similarly, let the number N2 be the number of taps in decision 
20 feedback equalization filter (DFEl) 720. The filter coefficients 
of decision feedback equalizer filter (DFEl) 720 at time k are 
= {g\. ^ 9^2]^ Decision feedback equalization filter 

(DFEl) 720 is a multiple input, single output time variant filter. 
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The contents of the delay lines of decision feedback 
equalization filter (DFEl) 720 at time k are a"" = {a\, a\, ... , 
a''n2} • The output of first stage equalizer 1310 at time k is 
denoted as Yk. The output Yk is computed as follows: 

5 

m Let rjc represent the input to the second stage equalizer {EQ2) 

'Z 1320. Let the number (Nl + 1) be the number of taps in forward 
l3 equalizer filter (FE2) 1350. The filter coefficients of forward 
i'fi equalizer filter (FE2) 1350 at time k are f^ = {f%, f\, ... , f'^Ni) - 
□ The output of forward equalizer filter (FE2) 1350 at time k is bk- 
U similarly, let the number N2 be the number of taps in decision 

^3 feedback equalization filter (DFE2) 1340. The filter coefficients 
15 of decision feedback equalizer filter (DFE2) 1340 at time k are 

= {g^i/ 9^2/ - • • / g^Na} - 

The outputs of trellis decoder 250 at time k are a^ = a^2, 
, a^s}. The output of second stage equalizer 1320 at time k is 
denoted as yk- The output yk is computed as follows: 

Nl N2 

20 Yk = S/'-'-^^+S^'"^*-" ^""^ 

Assume that X is the depth of the traceback memory of trellis 
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decoder 250. Further assume that M is the number of independent 
trellis decoder units in trellis decoder 250. For the ATSC 
standard, the value of M is twelve. Then, at time k, it is 
possible to obtain X decisions from the minimum path of the trellis 
decoder unit that is active at time k. The output decisions of 
trellis decoder 250 at time k are denoted by v^ = {v^l, v^2, . . . , 
v'^x} . It is then apparent that 

A'^^^Hd-i) ,1 = v\ for i = 1,2,...,X (5) 

A^^^n = a\-i for n M(i-1)+1 [n > 1] (6) 

The input of decision feedback equalization filter (DFE2) 1340 
is given by 

= (V) 
From this it is observed that only X locations in the feedback path 
of decision feedback equalization filter (DFEl) 720 need to be 
replaced with v^. When decision feedback equalization filter 
(DFEl) 720 is configured as a standard shift register delay line, 
corresponds to a fixed location in the delay line, thereby 
simplifying the implementation of the interface between trellis 
decoder 250 and the feedback path to decision feedback equalization 

filter (DFEl) 720. 

For adaptive channel equalization applications, the filter 
taps can be updated using standard algorithms with the second stage 
equalizer (EQ2) 1320. For forward equalizer filter (FE2) 1350 the 
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updated filter taps are: 

fn^'' = + fie^T-^^-n for n = 0,1,2, ... ,N1 (8) 

For decision feedback equalization filter (DFE2) 1340 the updated 
filter taps are: 

5 gn^^' - gn^ + Meicak-n for n := 0,1,2, ...,N1 (9) 

where m is a small constant and ej, is the error term. Note that 
during start-up the taps could be updated using the contents of the 
first stage equalizer (EQl) 1310. 
^0 The error needed to update the taps can be obtained either 

f| from blind algorithms (e.g., constant modulus algorithm (CMA) ) or 
,2 from decision directed algorithms. In the case of the decision 
directed algorithm, the error is calculated as : 

eic = ak - Yk (^0) 
The use of this expression for the error in the tap update 
equations requires that the decisions ak be reliable. These 
decisions in two stage equalizer 1300 are obtained from trellis 
decoder 2 50 deep in the traceback memory. Thus one may be tempted 
to assume that these decisions will be correct. However, there is 
no guarantee that these decisions will be correct. When the 
2 0 decisions are unreliable, then the use of the decision directed tap 
update process will result in a performance that is worse than the 
performance of the blind algorithms. 

In order to avoid the use of unreliable decisions in the 
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decision directed tap update process, a mechanism is needed to 

determine the reliability of the decisions. This reliability 

measure can be used to switch off and to switch on the decision 

directed tap update process. 
5 Inspection of the structure and operation of trellis decoder 

250 reveals that such a reliability measure can be extracted from 

the traceback memory in the following manner. When all the 

survivor paths of trellis decoder 2 50 stem from a single state, 
;S then it is most likely that the decision corresponding to this 
iy single state will be correct. This assumption in fact underlies 
j2 the basic fundamental concept of the Viterbi algorithm for trellis 

decoders . By measuring how many survivor paths stem from a 
'i particular state under consideration, the resulting measure can be 

used to switch between using (1) a decision directed tap update 
iS process, (2) a blind tap update process, (3) a combination of 

decision directed and blind tap update processes, and (4) using no 

tap update process. 

When switching between decision directed and blind tap update 

processes, one must be careful concerning the frequency of the 
2 0 switching. The switching between a decision directed tap update 

process and a blind tap update process must be carried out over a 
long period of time (i.e., over a large number of samples) to 
insure reliability. The reliability measure can be averaged over a 
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long period of time and the average value can be used to smoothly 
control the switching point between the two types of tap update 
processes . 

Due to implementation constraints; there will be some latency 
5 in the feedback path of the first stage equalizer (EQl) 1310, This 
latency is denoted by the letter d. Then Equation (2) will be 
modified as follows: 

:U This implies that post echoes that are d samples away from the main 
id path will not be equalized by the feedback portion of first stage 
ill equalizer (EQl) 1310, but rather by the forward equalizer portion 
^3 (i.e., forward equalizer filter (FEl) 710). In the conventional 
l'"^ equalizer case, these echoes will be equalized by the linear 
^3 equalizer. Because typical indoor channels have strong echo 
15 components near the main path, these echoes in the conventional 
case may stress the linear equalizer. 

In the two stage equalizer 1300 of the present invention, the 
second stage equalizer (EQ2) 1320 will not have any latency 
limitation because (unlike first stage equalizer (EQl) 1310) it 
2 0 does not comprise a true feedback system. Such post echoes could 
thus conveniently be handled by the second stage equalizer (EQ2) 
1320. Nevertheless, if the input from trellis decoder 250 has a 



- 45 - 



, . PATSNT 

Strong echo component, trellis decoder 250 may not produce reliable 
decisions . 

Because second stage equalizer (EQ2) 1320 is based on a 
forward system, a similar argument may be extended to the 
5 cancellation of pre-echoes (i.e., echoes that appear before the 
main path) using second stage equalizer (EQ2) 1320. The 
cancellation of pre-echoes may be achieved by suitably choosing the 
delay D in ^^first in, first out" buffer 1330 and by appropriate 

•fl computations in decision feedback equalization filter (DFE2) 1340. 
The delay D represents the delay between the signal (the input 

^jj to first stage equalizer (EQl) 1310) and the r^ signal (the input 
to second stage equalizer (EQ2) 1320) . 

^2 Assuming that the input to decision feedback equalization 

filter (DFE2) 1340 (i.e., ak) is quasi error free, it is tempting 

ti to assume that the pre-echoes can be cancelled by second stage 
equalizer (EQ2) 1320. However, the primary condition for the ak 
signals to be quasi error free is the cancellation of pre-echoes by 
first stage equalizer (EQl) 1310. If first stage equalizer (EQl) 
1310 does not adequately remove pre-echoes, then it will be 

20 difficult for trellis decoder 250 to produce correct decisions. 

FIGURE 14 illustrates a block diagram of a two stage equalizer 
14 00 having less complexity than the two stage equalizer 13 00 shown 
in FIGURE 13. The form of two stage equalizer 1400 is based on the 
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assumption that the forward filter coefficients f^ remain constant 
for the duration of D symbols. This assumption is valid for a 
relatively small value of D with respect to the dynamics of the 
channel. Under this assumption, it is reasonable to assume that the 
5 output, Bk, of forward equalizer filter (FEl) 710 and the output, 
bk, of decision feedback equalization filter (DFEl) 720 are related 
by: 

bk = Bk-D (12) 
^0 This means that a delayed output of forward equalizer filter (FEl) 
iy 710 can be substituted for the output of decision feedback 

equalization filter (DFEl) 720. 
m This arrangement is shown in FIGURE 14. Rk represents the 

■'2 input to forward equalizer filter (FEl) 710. The output of forward 
I;! equalizer filter (FEl) 710 (i.e., signal Bk) is provided to delay 
th buffer 1410 where the signal is delayed by D symbols. The output 

of delay buffer 1410 (i.e., signal bk) is provided to adder unit 

1360 . 

The output of trellis decoder 250 (i.e., signal ak) is 
provided to decision feedback equalization filter (DFE2) 1340. The 
20 output of decision feedback equalization filter (DFE2) 1340 is 
combined with signal bk in adder unit 13 60 or provide the two stage 
equalizer output yk- 

The output of trellis decoder 250 (i.e., signal ak) is 
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provided to error unit 1420. Trellis decoder 250 also sends to 
error unit 1420 a signal that represents the number of states 
identical to the state that produced a^. This number is referred 
to as the "confidence" number and is represented in FIGURE 14 with 
5 the letters "CONF." The "confidence" number is averaged and the 
averaged result is used to control the type of error calculation. 
Error unit 1420 also receives output signal yk- Error unit 1420 
calculates and outputs error signal ek- Error unit 1420 can 
calculate the error using either a blind error calculation 
1| algorithm or a least mean squares (LMS) calculation algorithm. 
''4 FIGURE 15 illustrates a block diagram of one advantageous 

embodiment of an implementation 1500 of two stage equalizer 1400. 
'5 In this configuration blocks that naturally share hardware are 
if; grouped together for seamless integration of the two stage 
tS equalizer of the present invention into a compact configuration. In 
implementation 1500 forward equalizer filter unit 1510 has two 
inputs. The first input, Rk, is needed for the computation of the 
tap updates. The second input, rk, is needed for the computation 
of the output yk. 

20 Decision feedback equalization filter unit 1520 has X symbol 

inputs 1530. The letter X represents the depth of the trellis 
decoder traceback memory. The two outputs of decision feedback 
equalization filter unit 1520 correspond to the output of decision 
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feedback equalization filter (DFEl) 720 and decision feedback 
equalization filter (DFE2) 1340. 

The error is calculated in error unit 1420 and passed to 
forward equalizer filter unit 1510 and to decision feedback 
5 equalization filter unit 1520 for tap update. Slicer 1550 is 
provided to make slicer decisions. Control unit 1560 provides 
control signals . 

Implementation 1500 requires a delay unit (within random 
^0 access memory (RAM) 154 0) to store the signals r^ and b^. The 
M signal rk is computed from the expression: 

= Rk-D (13) 
The signal bk is computed from the expression: 
^1 bk = Bk-D (14) 

Both of the sequences, rk and bk, can be stored using a single read 
i$ only memory (RAM) 1540. 

While the present invention has been described in detail with 
respect to certain embodiments thereof, those skilled in the art 
should understand that they can make various changes, substitutions 
modifications, alterations, and adaptations in the present 
2 0 invention without departing from the concept and scope of the 
invention in its broadest form. 
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